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Description 

AUTOSTEREOSCOPIC IMAGING APPARATUS AND METHOD 
USING A PARALLAX SCANNING LENS APERTURE 
Technical Field 

The present invention relates to a stereoscopic 
apparatus and method for producing images that can be 
displayed as three-dimensional illusions and more 
particularly to an autostereoscopic imaging apparatus and 
method for producing images that, on display, can be 
perceived to be three-dimensional without the use of special 
viewing aids. 
Background Art 

The production of two-dimensional images that can be 
displayed to provide a three-dimensional illusion has been a 
long standing goal in the visual arts field. Methods and 
apparatuses, for producing such three-dimensional illusions 
have to some extent paralleled the increased understanding of 
the physiology of human depth perception. 

Binocular (stereo) vision requires two eyes to view a 
scene with overlapping visual fields. Each eye views a scene 
from a slightly different parallax angle and focuses the 
scene unto a retina. The two-dimensional retinal images are 
transmitted by optic nerves to the brain's visual cortex, 
where they are combined, in a process known as stereopsis, to 
form a three-dimensional model of the scene. 

Depth perception of three-dimensional space depends on 
various kinds of information (cues) perceived from the scene 
being viewed, such as relative size, linear perspective, 
interposition, light and shadow, gradients (monocular cues) , 
as well as retinal image size, retinal disparity, 
accommodation, convergence (binocular cues) , and familiarity 
with the subject matter of the viewed scene (learned cues) . 

Retinal disparity, which is the separation between a 
person's eyes, provides parallax information. It is now well 
known that depth perception can be achieved when left and 
right eye depth information is presented alternately to the 
brain, as long as the time interval does not exceed 100 
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milliseconds. It has been demonstrated that the brain can 
. extract parallax information from a three-dimensional scene 
even when the eyes are alternately covered and uncovered for 
periods up to 100 milliseconds each. The brain c^n also 
accept and process parallax information presented to both 
eyes if sequenced properly. The ideal view cycle sequencing 
rate has been determined to be between 3-6 Hz. 

True three-dimensional image displays can be divided 
into two main categories , stereoscopic or binocular and 
autostereoscopic. Stereoscopic techniques (including 
stereoscopes, polarization, anaglyphic, Pulfrich, and' 
shuttering technologies) require the viewer to use a viewing 
device, such as polarized glasses. Autostereoscopic 
techniques, such as holography, lenticular screens, parallax 
barriers, alternating-pairs and parallax scans produce images 
in a true three-dimensional illusion without the use of 
special viewing glasses . 

Prior art autostereoscopic television and motion picture 
systems have utilized the approach of alternately displaying 
views of a scene recorded by two cameras from different 
points of view. U.S. Patent No. 4,006,291 to Imsand; U.S. 
Patent Nos. 4,303,316 to McElveen; U.S. Patent No. 4,429,328 
to Jones et al . ; U.S. Patent No. 4,966,436 to Mayhew & 
Prichard, all utilized two cameras to record horizontally, 
vertically, or a combination of horizontally and vertically 
displaced views of a scene. While this autostereoscopic 
approach produces images which provide three-dimensional 
illusion when displayed, precision matching of the two 
cameras is required. Improper alignment of the cameras, lens 
mismatches in focal length and/or focus, chrominance and 
illuminance mismatches, and misplaced convergent points all 
contribute to image instability. Also, considerable operator 
skill is required to continuously adjust disparity, 
convergence and time-displacement rates of image recordings 
in a coordinated manner to maintain a stable image. 

Image stability can be rendered less noticeable by the 
use of masking techniques. Camera motion is very effective 
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in hiding rocking motions of images, apparently because the 
brain places less importance on rocking motion than on camera 
motion. This could result from some sort of natural 
stabilizing phenomena or mechanism of the brain that allows 
us to see clearly while walking or running, when images would 
otherwise bounce . 

To avoid the drawbacks associated with a two -camera 
autostereoscopic system, autostereoscopic methods and 
apparatuses using a single camera/single lens have been 
developed. Mayhew et al . U.S. Patent Nos . 5,014,126 and 
5,157,484 disclose single camera autostereoscopic systems 
capable of recording images which, when displayed, are 
perceived by a viewer in three -dimension. Commonly assigned, 
copending U.S. Patent Application No. 08/115,101, filed 
September 2, 1993 by Fernekes et al . discloses a method and 
apparatus, wherein a single camera records images while 
undergoing oscillatory parallax scanning motion. 

While the single camera autostereoscopic imaging systems 
disclosed in the above cited prior art are effective in 
producing high quality, stable images that can be perceived 
in three -dimension when viewed with the unaided eye, 
unfortunately the apparatuses are rather bulky and heavy, 
relatively complex in construction, and consume a meaningful 
amount of power in operation. 

Disclosure of the Invention 
A principal objective of the present invention is to 
provide improved method and apparatus for producing images in 
two-dimension that, upon display, can be perceived as 
three-dimensional with the unaided eye. The method and 
apparatus of the invention utilize an autostereoscopic 
approach to three-dimensional imaging, thus avoiding the 
drawbacks inherent in the stereoscopic approach. The 
autostereoscopic method and apparatus of the present 
invention utilizes a single imaging device, such as a motion 
picture or video camera, and thus the disadvantages of a 
two- camera autostereoscopic approach are avoided. Moreover, 
the apparatus of the present invention is compact in size and 
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light weight, efficient in construction and operation, and 
convenient to. implement in conventional motion picture and 
video cameras. 

To achieve these objectives and advantages, the improved 
single- camera autostereoscopic imaging method of the present 
invention comprises the steps of providing an imaging lens 
having an optical axis directed toward a scene, providing a 
lens aperture, moving the aperture relative to the lens in a 
parallax scanning pattern through diverse disparity points 
displaced from the optical axis of the lens, generating a 
succession of time-spaced images of the scene as viewed 
through the aperture from a plurality of the disparity 
points, and recording the images. This method can be 
practiced using an imaging device, such as a motion picture 
camera or a video camera, or a computer suitably programmed 
to simulate the lens, the aperture and the lens aperture 
motion. 

The apparatus .of the present invention, in its most 
basic form, includes an imaging plane, a lens for focusing 
images of objects in a field of view on the imaging plane, an 
optical element positioned adjacent the lens and providing an 
aperture, and an actuator for oscillating the optical element 
such as to produce a parallax scanning motion of the aperture 
relative to the optical axis of the lens. A succession of 
time-spaced recordings are made of the object images focused 
on the imaging plane, as viewed through the aperture from a 
plurality of different parallax views or disparity points 
offset from the lens optical axis. 

By virtue of the method and apparatus of the present 
invention, display of the two-dimensional image recordings in 
corresponding time -spaced succession can be perceived as a 
three-dimensional illusion. 

The single camera autostereoscopic imaging method and 
apparatus of the present invention are readily conducive to 
numerous modifications. The aperture may be located in front 
of or behind the lens or between lenses of a multiple lens 
set. The aperture may take a variety of sizes and shapes, be 
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adjustable in size and/or have different edge 

characteristics. Furthermore, more than one aperture may be 
utilized. The pattern of the parallax scanning motion of the 
aperture may be of a variety of configurations ranging from 
circular to rectangular to complex lissajous configurations. 
The optical element may take the form of one or more opaque 
cards having one or more through-holes or slits serving to 
create a lens aperture. Also, the optical element can be 
implemented as a liquid crystal panel or a ferro-electric 
panel (spatial light modulator) providing a matrix array of 
cells that can be selectively switched between opaque and 
transparent states. 

Moreover, depth information derived from the images of 
objects viewed through the lens aperture during parallax 
scanning motion can be utilized in range finding 
applications. In addition, controlled lens aperture movement 
can be utilized to compensate for spurious camera motion and 
thus stabilize image recordings. 

It is to be understood that both the foregoing general 
description and the following de called description are 
exemplary and are intended to provide further explanation of 
the invention as claimed. 

The accompanying drawings are included to provide a 
further understanding of the invention and are incorporated 
in and constitute part of this specification, illustrate 
embodiments of the invention and together with the 
description serve to explain the principles of the invention. 
Brief Description of the Drawings 
Fig- 1 is a perspective view, partially in schematic 
form, illustrating one embodiment of the present invention. 

Fig. 2 is a perspective view, partially in schematic 
form, illustrating an alternative embodiment of the 
invention. 

Fig. 3 is a perspective view of an alternative form of 
optical element that, can be utilized in the embodiments of 
Figs . 1 and 2 . 
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Fig. 4 is a side view, partially in schematic form, of 
another embodiment of the invention. 

Figs. 5 (a) -5(d) illustrate various aperture 
configurations that may be utilized in the embodiments of 
Figs . 1 and 2 . 

Figs. 6 (a) -6(f) illustrate alternative parallax scanning 
patterns that may be executed by the optical elements in 
Figs . 1-4 . 

Fig. 7 is a schematic diagram illustrating various 
controls that would typically be applied to the 
autostereoscopic imaging embodiments of Figs. 1 and 2 in 
practicing the present invention. 

Fig. 8 is a front view of an alternative opcical element 
usable in the embodiments of Figs. 1, 2 and 4. 

Fig. 9 is a flow chart illustrating an application of 
the present invention to computer generated imaging. 

Figs. 10 (a) -10(c) are schematic diagrams illustrating 
the operation of the autostereoscopic imaging apparatus of 
the present invention. 

Fig. 11 is a schematic diagram illustrating the 
application of the present to range finding. 

Fig. 12 is a schematic diagram illustrating the 
application of the present invention to camera image 
stabilization. 

Fig. 13 is a schematic diagram illustrating the 
application of automatic disparity control to the 
autostereoscopic imaging apparatus of the present invention. 

Like reference numerals refer to corresponding parts 
throughout the several view of the drawings . 

Detailed Description 

The autostereoscopic imaging apparatus of the present 
invention disclosed in Figs. 1-8 is directed to a 
stereoscopic imaging application wherein a succession of 
time -spaced images of a scene are recorded by a single 
imaging device in a manner such that a subsequent display of 
the images can be perceived as three-dimensional. Thus, as 
seen in Fig. 1, an autostereoscopic imaging apparatus, 
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generally indicated at 20, includes an imaging plane 22 of a 
suitable imaging device such as a film camera or video 
camera. Reference 24 indicates a camera lens which in 
practice typically comprises a set or system of multiple 
lenses. Lens 24 has an optical axis 25 which is directed at 
a distant object 2 6 in a scene to.be imaged. In a 
conventional manner, the position of lens 24 is adjusted 
forwardly or rearwardly, as indicated by arrow 27/ along its 
optical axis to focus an image 26a of object 26 on imaging 
plane 22 which represents the film plane of a film camera or 
a CCD array of a video camera . 

In accordance with a signal feature of this embodiment 
of the present invention, an optical element 28, consisting 
of an opaque card 29 in which is formed a through- hole or 
aperture 30, is positioned between object 26 and imaging 
plane 22. Fig. 1 illustrates an optical element position 
immediately behind lens 24, i.e., between the lens and 
imaging plane 22, while Fig. 2 illustrates optical element 28 
immediately in front of lens 24. Preferably, the optical 
element is located as close as possible to the lens iris (not 
shown) which can be positioned between lenses of a multiple 
lens set typically used in a camera. Ideally, optical 
element 28 would assume the position of and replace the lens 
iris . 

The optical element is mechanically linked, as 
schematically indicated at 32, to an actuator or motor 34 
which operates to move aperture 3 0 in a parallax scanning 
motion relativie to lens optical axis 25. A circular parallax 
scanning pattern for aperture 3 0 is illustrated by arrow 36 
in Fig. 1, while a rectangular scanning pattern is 
illustrated by arrow 38 in Fig. 2. Other parallax scanning 
patterns are illustrated in Figs. 6 (a) -6(f). Normally the 
aperture scanning patterns are centered about lens optical 
axis 25, however, under certain conditions, desirable visual 
effects can be achieved when the scanning pattern is off- 
centered relative to this optical axis . While scanning 
patterns will typically be limited to horizontal (X) and 
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vertical (Y) coordinate motions in the plane of optical 
element 28 and transverse to optical axis 25, it will be 
understood that Z coordinate motion parallel to the optical 
axis, as illustrated by arrow 3 5 in Fig. 1, may be introduced 
in conjunction with X and Y coordinate motions for special 
effects and to mask motion artifacts. 

With reference to Fig*. : 2 , it is seen that light rays 4 0 
from the top of object 26 pass through aperture 30 and are 
redirected by lens 24 toward a lower location on imaging 
plane 22 where a focused image of the object top is formed. 
Similarly, light rays 41 from the bottom of object 26 pass 
through aperture 3 0 and are redirected by the lens toward an 
upper location on the imaging plane where a focused image of 
the object bottom is formed. Light rays from objects 
portions between its top and bottom likewise pass through 
aperture 3 0 aiid lens 24 to complete the formation of focused 
image 26a. If an image 26a is recorded while aperture 30 is 
in the position shown in Fig. 2, it is seen that the point of 
view of this image has a vertical disparity represented by 
arrow 42 which is equal to the distance below optical axis 
25, If the object image is recorded while the aperture is in 
phantom line position 3 0a indicated in Fig. 2, the point of 
view has a disparity equal to the vertical offset above the 
optical access as represented by arrow 42a. Similarly, image 
recordings taken while aperture 3 0 is in phantom line 
positions 30(b) and 30(c) have horizontal disparities equal 
to the aperture horizontal offsets from the optical axis 25. 

Disparity, whether horizontal or vertical or components 
of both, is largely responsible for adding parallax to visual 
images. Portions of object volumes having essentially flat 
surfaces produce images which appear flat and 
two-dimensional. Changes in the viewing perspective do not 
change the appearance of these portions. However, portions 
of a object volume naturally having depth when viewed 
directly, do change their appearance or, more specifically, 
their position and aspect, as the viewing perspective is 
changed. Changes in the viewing perspective create 
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corresponding edges on the image which do not perfectly match 
when the images are superimposed. Alternatively displaying 
these images creates contrast at these edges which is 
perceptible to the brain as depth. 

Fig. 3 illustrates an alternative embodiment of an 
optical element, generally indicated at 50, for use in the 
apparatus of Figs . 1 and 2 . This optical element includes a 
pair of opaque c*-.rds 52 and 54 arranged in juxtaposed, 
parallel relation. Card 52 is provided with a vertically 
elongated, rectangular slit 53, while card 54 is provided 
with a horizontally elongated, rectangular slit 55 . At the 
intersection of slits 53 and 55, a rectangular lens aperture 
56 is created. An actuator 58 reciprocates card 52 in the 
horizontal direction, as indicated by arrow 58a, and an 
actuator €0 reciprocates card 54 in the vertical direction, 
as indicated by arrow 60a. It is seen that, by virtue of the 
relative motions of the cards, scanning motion of aperture 56 
is produced. By adjusting amplitude, frequency, and phase of 
the card reciprocating motions, the lissajous parallax 
scanning patterns illustrated in Figs. 1, 2 and 6 (a) -6(f), as 
well as many other patterns, are readily actuated. While the 
lens aperture configuration is circular in Figs. 1 and 2 and 
rectangular in Fig. 3, it may take other shapes, such as, for 
example, elliptical as illustrated in Fig. 5(a), octagonal as 
illustrated in Fig, 5(b), and cruciform as illustrated in 
Fig. 59(c). Fig. 5(d) illustrates that the lens aperture may 
have a soft or frayed edge, rather than a hard or sharp edge. 

Regardless of the lens aperture configuration, it is 
important that it be bordered throughout by the opaque 
material of the optical element 28. Also, the parallax 
scanning pattern of the lens aperture should remain within 
the effective aperture of lens 24, which typically 
corresponds to 80% of the lens diameter. Thus, the size of 
lens aperture 3 0 should be significantly less than the size 
of this effective aperture of the lens, so that the lens 
aperture can assume disparity positions of sufficiently 
different reviewing perspectives (disparity) needed to 
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provide depth perception. It will thus be appreciated that, 
as the size of lens aperture 30 increases , the depth of 
field, disparity, and exposure time will all decrease. 
Conversely, smaller lens aperture sizes provide larger depths 
of field, accommodate greater disparities, and require longer 
exposure times . ■ 

While the embodiments of Figs. 1-3 utilize a single 
parallax scanning aperture, plural apertures may be utilized. 
As seen in Fig. 4, a pair of optical elements 70 and 72 are 
respectfully formed with lens apertures 71 and 73. Optical 
element 70 is positioned behind lens 24, and optical el'ement 
72 is positioned in front of the lens. Optical element 70 is 
oscillated by an actuator 74, while optical element 72 is 
oscillated by an actuator 76. These actuators are controlled 
by a controller 78 to produce parallax scanning motions of 
apertures 71 and 73 • The scanning patterns of the two lens 
apertures may be of the same or different configurations and 
may be in synchronism with or independent of each other. The 
use of two parallax scanning apertures may be used for 
special effects and/or to mask a motion artifacts of object 
26 as imaged on imaging plane 24. 

Fig. 7 illustrates lens 24, optical element 28 and 
actuator 34 carried by a lens mount, schematically 
illustrated in phantom line at 80. Also included on the lens 
mount is an F stop adjustor 84 for adjusting the size of lens 
aperture 30 in accordance with available light and desired 
depth of field. Lens mount is moved fore and aft (arrow 85) 
by focus adjustor 86. A controller 88 may be provided to 
control actuator 34 to a desired parallax scanning motion for 
lens aperture 30, control F stop adjustor 84 to a desired 
lens aperture size, and control focus adjustor 86 to bring 
into focus a desired subject in the field : of view. 

As illustrated in Fig. 8, an optical element can also be 
implemented as a liquid crystal or ferro-electric panel 
(spatial light modulator), generally indicated at 90. These 
panels include a matrix array of cells 92 which can be 
individually addressed and activated by a driver 94 to create 
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one or more transparent cells 92a amongst a remainder of 
opaque cells 92b. The transparent cell or cells 92a thus 
constitute a lens aperture 96 which can be readily moved 
about in a variety of parallax scanning patterns, including 
those illustrated in Figs. 6 (a) -6(f), by driver 94. ; 

It will be appreciated that driver 94 may be externally, 
manually or automatically controlled, as indicated at; 98, to 
vary the size and shape of aperture 96, as well as the 
configuration of the parallax scanning patter of the 
aperture. Moreover, as indicated at. 96(c), driver 94 can 
readily introduce one or more parallax scanning or stationary 
lens apertures, in addition to aperture 96, to create special 
effects or to mask motion artifacts. Also, rather than 
abruptly switching the cells between transparent and opaque 
states, the transition may be effected somewhat gradually 
through progressively changing degrees of gray scale. In 
practice, driver 94 and controller 98 may be implemented by a 
suitably programmed digital computer. 

The principles of the present invention may also be 
applied in the computer generation of images which then can 
be displayed in three-dimensional illusion. Fig. 9 
illustrates the basis steps involved. In step 100, an object 
and object motion are defined in three-dimensional space, and 
a scene to in . iude the object is also defined in three- 
dimensional space in step 102. The imaging device or camera, 
camera positions (points of view) , illumination, range, etc., 
are defined in step 104. Camera definitions include 
simulations of an imaging plane, lens and lens aperture 
parameters, such as size and shape. In step 106 the image is 
rendered by simulating a desired parallax scanning pattern of 
the lens aperture using a suitable ray tracing algorithm, and 
the rendered images are stored in computer memory on a frame - 
by- frame basis (step 108) . The stored images can then be 
retrieved from memory for display on a computer monitor, 
recorded on video tape for display on a TV screen and/or 
recorded on film for projection on a screen (step 110). 
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From the foregoing description, it will be noted that, 
since only the lens aperture undergoes parallax scanning 
motion while the lens 24 remains stationary, the point of 
view of the lens aperture is always convergent on the object 
to which the lens is focused. Thus, unlike prior single- 
camera autostereoscopic imaging apparatuses, such as 
disclosed in, for example, the cited U.S. Patent Application 
Serial No. 08/115,101, a separate convergence adjustment is 
avoided in the apparatus of the present invention. That is, 
focus adjustment inherently establishes the appropriate 
convergence setting, which is an important feature of the 
present invention. 

Figs. 10 (a) -10 (c) are schematic diagrams illustrating 
how this important feature of the invention can be used to an 
advantage. In Figs. 10(a), 10(b) and 10(c) , objects A, B, 
and C represent objects at close range, mid-range, and far 
range, respectively, relative to imaging plane 22. If lens 
24 is focused on far range object C, as depicted in Fig. 
10(a), the image of this object appearing on imaging plane 22 
remains stationary during parallax scanning motion of 
aperture 30. However, when aperture 3 0 moves upwardly to 
positions of vertical disparity above optical axis 25, for 
example, the images of objects A and B appearing on imaging 
plane 22 move downwardly, as indicated by phantom lines 120, 
relative to the stationary image of object C. Conversely, 
when aperture 30 moves downwardly to positions of vertical 
disparity below the optical axis, the images of objects A and 
B appearing on the imaging plane move upwardly, as indicated 
by phantom lines 122, relative to the stationary image of 
object C. 

When lens 24 is focused on object B, as illustrated in 
Fig. 10(b), the image of this, object remains stationary as 
aperture 3 0 undergoes parallax scanning motion. As the 
aperture scans upwardly; through positions of vertical 
disparity above optical axis 25, the image of object A 
appearing on imaging plane 22 moves downwardly, as indicated 
in phantom line at 123, relative to the stationary image of 
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object B, while the image of object C appearing on the 
imaging plane moves upwardly, as indicated in phantom line at 
124, relative to the object B stationary image. When the 
aperture moves downwardly through positions of vertical 
disparity below optical axis 25, the reverse conditions 
obtained, i.e., the image of object A moves upwardly (phantom 
lines 125) , and the image from object C moves downwardly 
(phantom lines 126) relative to the stationary image of 
object B. 

If lens 24 is focused on close range object A, the 
images of objects B and C move upwardly, as indicated by 
phantom lines 127, relative to the stationary image of object 
A, when aperture 30 scaiis through vertical parallax positions 
above optical axis 25. Conversely, the images of objects B 
and C move downwardly, as indicated in phantom line at 128, 
relative to the stationary image of object A when the lens 
aperture moves through vertical disparity positions below the 
optical axis. 

This phenomena of relative motions of images of objects 
in the lens field of view observed during parallax scanning 
motion of lens aperture 3 0 can be utilized to advantage in 
range finding applications. Considering Fig. 10(c), assume 
that aperture 30 is scanned between positions of maximum 
vertical disparity (maximum offset from optical axis 25) to 
maximize the image motion of object B relative to the 
stationary image of object A to which the lens 24 is focused. 
If the distance between object A and a camera reference 
point, such as imaging plane 22, is known, the distance 
between object A and object B can be determined from the 
magnitude of the motion of the object B image relative to the 
object A image or from the peak-to-peak amplitude, indicated 
at 129, of the object B image motion. Such determination can 
be accurately computer calculated by triangulation using 
recorded images of objects A and B taken, for example, from 
extreme disparity points above and below optical axis 25. 
Alternatively, the measured amplitude 129 of object B image 
motion produced by aperture parallax scanning motion between 
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extreme vertical disparity points can be used to access a 
look-up table and thereby determine the separation between 
objects A and B. It will be appreciated that a rather close 
approximation of the range of objects A, B and C from imaging 
plane 22 can be obtained by adjusting the focus of lens 24 to 
any one of these objects until the image of this object 
becomes stationary as appearing on imaging plane 22 . The 
object range can then be determined from the focus setting 
that completely quiets all motion of the object image as 
observed on a video screen displaying the object image. 

Fig. 11 illustrates an application of the present' 
invention to a range-finding video camera 130 mounted by a 
robotic arm, generally indicated at 132. The video camera, 
located on the robotic arm in a reference position , is 
oriented to view a scene including a stationary reference 
object 134 and a target object 13 6 which is to be griped by a 
hand 133 of the robotic arm. The distance between video 
camera 13 0 in its reference position and reference object 134 
is known. When the camera lens is focused on reference 
object 134, images of the reference and target objects are 
recorded as the lens aperture undergoes parallax scanning 
motion. The recorded images are analyzed by a computer 13 8 
to determine the range of the target object relative to the 
camera based on the magnitude of target image motion relative 
to the stationary reference image and. the known distance 
between the camera and the reference object. Knowing the 
target object range, the computer can readily control the 
motion of robotic arm 132 to bring hand 13 3 rapidly into the 
grasping relation with target object 136. It will be 
appreciated that video camera 13 0 may be stationed at any 
fixed reference position a known distance from reference 
object 134, rather than being mounted by the robotic arm. 

By virtue of the present invention, parallax information 
sufficient to determine target range can be acquired using a 
single imaging device, e.g., video camera. This is a 
distinct advantage over the conventional practice of using 
two video cameras or sets of parallax mirrors and prisms. 
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Another application of the present invention is 
illustrated in Fig. 12 , which utilizes a moving lens aperture 
30 to compensate for spurious motion of an imaging device 
140, such as a film or video camera, and thus to stabilize 
the images ' of an object 26 focused on the imaging plane 22 of 
the camera. To implement this application of the invention, 
camera 140 is equipped with an inertial sensor 142, such as 
an accelerometer. This sensor sends signals indicative of 
camera motion to a controller 144 which translates the camera 
motion signals into drive signals for actuator 34 drivingly 
connected to optical element 28. If, during imaging of 
object 26, camera 140 experiences spurious upward motion, 
sensor 142, via controller 144, signals actuator 34 to move 
optical element 28 and thus lens aperture 3 0 downward. 
Downward camera motion induces upward motion of the lens 
aperture . It will be appreciated that by moving lens 
aperture in the opposite direction to spurious camera motion, 
the images of object 2 6 focused on the camera imagining plane 
by lens 24 can be stabilized against such camera motion. 
Image stabilization by compensating motion of the lens 
aperture in accordance with the present invention can be 
implemented quite inexpensively as compared with the current 
practices of gyro- stabilization of the entire camera or the 
use of moving mirrors and/or prisms to compensate for camera 
motion and thus steady the object images appearing on the 
camera imaging plane . 

The motion of objects in a scene being imaged, such as 
objects A, B and C in Figs, 10 (a) -10(c), caii also be used to 
automatically control lens aperture motion. Thus as 
illustrated in Fig. 13, a camera 150, such as a video or film 
camera, is aimed to view a scene 152 including objects A, B 
and C. The camera lens 24 is adjusted to focus the image of 
one of these objects on an imaging plane 22. Images of the 
scene are stored on a frame -by- frame basis in an image frame 
buffer 154. A computer 156 compares successive stored image 
frames, such as by subtracting one from the other, to 
quantify the motion characteristics of the images of the 



9512954A1_L> 



WO 95/12954 



PCTAJS94/12243 



- 16 - 

other objects relative to the stationary image of the focused 
object. The quantified motion characteristics are used by a 
controller 158 to adjustably control the parallax scanning 
motion, produced by actuator 34, of lens aperture 30 in 
optical element 28. In this manner, a desired three- 
dimensional effect can be automatically achieved by 
constantly monitoring the motions of object images appearing 
on imaging plane 22 and adjusting amplitude (offset of 
disparity positions from lens optical axis) and frequency of 
the lens aperture scanning motion according to the extents of 
relative image motions. 

While the present invention has been described in the 
context of moving a lens aperture in a parallax scanning 
motion as images of objects are recorded at a rate of three 
to six Hz, it will be appreciated that effective depth 
perception of displayed images or object range can be 
achieved by providing an optical element which can 
alternatingly create a lens aperture at different disparity 
positions offset from the lens optical axis. Thus, rather 
than moving a single aperture in a parallax scanning motion 
through different disparity positions, an equivalent parallax 
scanning motion can be achieved by utilizing an optical 
element or combination of optical elements operated to create 
momentary lens apertures at various disparity positions 
vertically, horizontally and/or both horizontally and 
vertically offset from the lens optical axis. Using this 
approach, the optical element or elements can function as the 
camera shutter, as well as the lens aperture. The optical 
element of Fig. 8 is particular suited for this approach to 
the practice of the present invention. 

It will be apparent to one skilled in the art that 
various modifications and variations can be made in the 
autostereoscopic imaging apparatus of the present invention 
without departing from the scope or spirit of the invention. 
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Thus, it is intended that the present invention cover 
modifications and variations of this invention provided they 
come within the scope of the appended claims and their 
equivalents. 
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Claims 

1. Autostereoscopic imaging apparatus comprising, in 
combination: 

an imaging plane; 

a lens having an optical axis, said lens focusing images 
of a three-dimensional object on said imaging plane; 

an optical element defining an aperture, said optical 
element located adjacent said lens, such that the object 
image is created from light passing through the aperture; and 

an operator coupled to move said optical element, such 
as to produce a scanning motion of the aperture relative to 
the optical axis of said lens while a succession of 
recordings of the object image are taken. 

2. The autostereoscopic imaging apparatus of claim 1, 
wherein said optical element is located between said lens and 
said imaging plane. 

3. The autostereoscopic imaging apparatus of claim 1 
wherein said optical element is located between the object 
and said lens . 

4. The autostereoscopic imaging apparatus of claim 1, 
wherein said optical element is located in an iris position 
of said lens . 

5. The autostereoscopic imaging apparatus of claim 1, 
wherein the scanning motion of the aperture is in a plane 
transverse to the optical axis of said lens. 

6. The autostereoscopic imaging apparatus of claim 1, 
wherein the scanning motion includes X and Y coordinate 
motions transverse to the optical axis of said lens and a Z 
component of motion parallel to the optical axis . 

7. The autostereoscopic imaging apparatus of claim 5, 
wherein said optical element is an opaque sheet, and the 
aperture is a through-hole in said sheet. 

8. The autostereoscopic imaging apparatus of claim 7, 
wherein the hole has a hard edge. 

9. The autostereoscopic imaging apparatus of claim 7, 
wherein the hole has a soft edge. 
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10 • The autostereoscopic Imaging apparatus of claim 7, 
wherein the hole is one of circular, elliptical , polygonal 
and irregular configurations. 

11 ♦ The autostereoscopic imaging apparatus of claim 5, 
wherein the scanning motion of the aperture is symmetrical 
with respect to the optical axis of said lens. 

12 «f The autostereoscopic imaging apparatus of claim 5 , 
wherein the scanning motion of the aperture traces one of 
circular, elliptical, figure eight, and polygonal scanning 
patterns. 

13. The autostereoscopic imagining apparatus of claim 
5, wherein the scanning motion of the aperture traces a 
lissajous scanning pattern. 

14. The autostereoscopic imaging apparatus of claim 1, 
further including means for adjusting an opening size of the 
aperture. 

15. The autostereoscopic imaging apparatus of claim 1, 
further including means for changing a pattern traced by the 
scanning motion of the aperture. 

16. The autostereoscopic imaging apparatus of claim 1, 
wherein said optical element is a first optical element 
defining a first aperture and said operator is a first 
operator, said first optical element being located behind 
said lens, said apparatus further including: 

a second optical element defining a second aperture, 
said second optical element located in front of and adjacent 
said lens; and 

a second operator coupled to move said second optical 
element, such as to produce scanning motion of the second 
aperture relating to the optical axis of said lens . 

17. The autostereoscopic imaging apparatus of claim 1, 
wherein said optical element includes: 

a first opaque sheet having a first through-slit 
elongated in a first direction, and 

a second opaque sheet having a second through-slit 
elongated in a second direction generally orthogonal to the 
first direction, said first and second sheets positioned in 
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parallel juxtaposed relation, such that an intersection of 
the first and second slits defines the optical element 
aperture, and said operator includes: 

a first actuator coupled to reciprocate said first sheet 
in the second direction, and 

a second actuator coupled to reciprocating said second 
sheet in the first direction, 

whereby to produce scanning motion of the aperture . 

18. The autostereoscopic imaging apparatus defined in 
claim 17, wherein said operator further includes a controller 
controlling said first and second actuators to adjust at 
least one of relative phase, frequency and stroke of 
reciprocations of said first and second sheets, where to vary 
a pattern traced by the parallax scanning motion of the 
aperture, 

19. Autostereoscopic imaging apparatus, comprising, in 
combination: 

an imaging plane ; 

a lens having an optical axis, said lens focusing an 
image of a three-dimensional object on said imaging plane; 
an optical element located adjacent said lens; and 
an operator coupled to activate said optical element 
such as to define a lens aperture located in at least two 
disparity positions offset from the optical axis of the lens 
while recordings of the focused object image are taken, 
whereby to provide image recordings having differing parallax 
views of the object. 

20. The autostereoscopic imaging apparatus of claim 19, 
wherein said operator activates said optical element such as 
to move the lens aperture in a parallax scanning motion 
through the disparity positions. 

21. The autostereoscopic imaging apparatus of claim 19, 
which further includes means for adjusting an opening size of 
the lens aperture. 

22. The autostereoscopic imaging apparatus of claim 19 , 
which further includes means for varying a pattern traced by 
the parallax scanning motion of the lens aperture. 
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23. The autostereoscopic imaging apparatus of claim 19, 
wherein said operator is conditioned to concurrently define 
plural lens apertures. 

24. The autostereoscopic imaging apparatus of claim 19, 
wherein said optical element comprises a planar array of 
cells, and said operator electrically activates said optical 
element to 'selectively switch said cells between transparent 
and opaque states, said cells in the transparent state 
defining the lens aperture. 

25. The autostereoscopic imaging apparatus of claim 24, 
which further includes means for controlling said operator 
such as to adjust a number of said cells activated to the 
transparent state, whereby to vary an opening size of the 
lens aperture. 

26. The autostereoscopic imaging apparatus of claim 24, 
which further includes means for controlling said operator to 
continuously activate said cells between the transparent and 
opaque states in a manner to produce parallax scanning motion 
of the lens aperture through the disparity positions. 

27. A method of autostereoscopic imaging, comprising 
the steps of: 

providing imaging lens means having an optical axis 
directed toward a scene to be imaged; 
defining a lens aperture; 

moving the lens aperture relative to the lens means 
through diverse disparity positions offset from the optical 
axis of the lens means; and 

. generating a succession of time-spaced images of the 
scene as viewed through the aperture from a plurality of the 
disparity positions; and 

recording thei time-spaced images. 

28. The method of claim 27, further including the step 
of adjusting an opening size of the aperture. 

29. The method of claim 27, wherein the moving step 
produces an adjustable parallax scanning motion of the lens 
aperture. 
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30. The method of claim 27 f further including the steps 

of: 

providing a camera incorporating the lens means and the 
aperture ; 

pointing the camera at a scene including a reference 
object positioned a known distance from the camera and a 
target object; 

focusing the lens means to the reference object; and 
quantifying the motion of the recorded target object 
images relative to the recorded reference object images to 
determine the distance between the reference and targets 
objects. 

31. The method of claim 30, further including the steps 

of: 

mounting the camera on a piece of robotic equipment; and 
controlling the motion of the robotic equipment piece 
into an operative position relative to the target object 
based on the determined distance between the reference and 
target objects • 

32. The method defined in claim 27, further including 
the steps of: 

providing a camera incorporating the lens means and the 
lens aperture; 

pointing the camera at a scene including a plurality 
objects; 

detecting, from the recordings of the time-spaced images 
of the scene, relative motions of the images of the objects; 
and 

controlling the moving step to adjust the optical axis 
offset of the disparity positions through which the lens 
aperture is moved in accordance with the detected relative 
motions of the object images. 

33. A method of autostereoscopic imaging comprising the 
steps of : 

providing an imaging plane; 

providing a lens having an optical axis; 
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directing the optical axis toward an object; 

creating a lens aperture at a succession of disparity- 
positions offset from the optical axis; 

observing an image of the object appearing on the 
imaging plane; and 

adjusting the lens to a focus setting that eliminates 
motion of the* object image appearing on the imaging plane. 

34. The method of claim 33 , further including the step 
of determining object range from the focus setting. 

35. A camera for recording video images of a scene, 
said apparatus including, in combination: 

an imaging plane; 

a lens for focusing images of the scene on the imaging 
plane, said lens having an optical axis; 

an optical element defining a lens aperture, said 
optical element positioned adjacent said lens such that the 
scene images appearing on said imaging plane axe created by 
light passing through the aperture; and 

an actuator coupled to said optical element such as to 
produce movement of the aperture in directions transverse to 
the optical axis . 

36. The camera of claim 35, further including means 
connected to selectively activate said actuator to produce 
controlled movement of the aperture. 

37. The camera of claim 36, wherein said means 
selective activates said actuator to produce parallax 
scanning motion of the aperture. 

38. The camera of claim 36, wherein said means is a 
motion sensor mounted on the camera, said motion sensor 
activating said actuator to produce aperture movement in a 
direction opposite to a direction of spurious camera motion, 
whereby to stabilize the scene images appearing on the 
imaging plane* 

39. A method of autostereoscopic imaging using computer 
simulation, the method comprising the steps of: 

defining an object to be imaged; 
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defining a scene to include the object; 

simulating a camera by defining parameters of an imaging 
plane, a lens and a lens aperture; 

rendering images of the object by simulating a desired 
parallax scanning pattern of the lens aperture using a ray 
tracing algorithm; and 

storing the rendered images for subsequent display in 
perceived three-dimensional illusion. 



SUBSTITUTE SHEET (RULE 26) 

9512954A1_I_> 



WO 95/12954 



- 25 - 



PCT/US94/12243 



AMENDED CLAIMS 

[received by the International Bureau on 13 April 1995 (13.04.95); 
original claims 1,18,19,27,35 and 39 amended; 
remaining claims unchanged (7 pages)] 

1. Autostereoscopic imaging apparatus comprising, in 
combination: 

an imaging plane; 

a lens having an optical axis, said lens focusing images 
of a three-dimensioaal object on said imaging plane; 

an optical element defining a dens aperture, said 
optical element located adj acent said lens , such that the 
object image is created from light passing through the lens 
aperture; and 

an operator coupled to move said optical element, such 
as to produce a parallax scanning motion of the lens aperture 
relative to the optical axis of said lens to record on said 
imaging plane a succession of recordings of the object image 
which, when successively displayed at a view cycle sequencing 
rate of three to six Hz, produce an autostereoscopic image of 
said object on a conventional, two-dimensional display, 

2. The autostereoscopic imaging apparatus of claim 1, 
wherein said optical element is located between said lens and 
said imaging plane. 

3* The autostereoscopic imaging apparatus of claim 1 
wherein said optical element is located between the object 
and said lens. 

4 . The autostereoscopic imaging apparatus of claim 1 , 
wherein said optical element is located in an iris position 
of said lens. 

5 . The autostereoscopic imaging apparatus of claim 1 , 
wherein the scanning motion of the aperture is in a plane 
transverse to the optical axis of said lens - 

6. The autostereoscopic imaging apparatus of claim 1, 
wherein the scanning motion includes X and Y coordinate 
motions transverse to the optical axis of said lens and a Z 
component of motion parallel to the optical axis. 

7. The autostereoscopic imaging apparatus of claim 5, 
wherein said optical element is an opaque sheet, and the 
aperture is a through-hole in said sheet. 
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8 . The autostereoscopic imaging apparatus of claim 7 , 
wherein the hole has a hard edge . ' 

9. The autostereoscopic imaging apparatus of claim 7, 
wherein the hole has a soft edge. 

10. The autostereoscopic imaging apparatus of claim 7, 
wherein the hole is one of circular, elliptical, polygonal 
and irregular configurations. 

11. The autostereoscopic imaging apparatus of claim 5, 
wherein the scanning motion of the aperture is symmetrical 
with respect to the optical axis of said lens. 

12. The autostereoscopic imaging apparatus of claim 5, 
wherein the scanning motion of the aperture traces one of 
circular, elliptical, figure eight, and polygonal scanning 
patterns. 

13. The autostereoscopic imagining apparatus of claim 
5, wherein the scanning motion of the aperture traces a 
lissajous scanning pattern. 

14. The autostereoscopic imaging apparatus of claim 1, 
further including means for adjusting an opening size of the 
aperture . 

15. The autostereoscopic imaging apparatus of claim 1, 
further including means for changing a pattern traced by the 
scanning motion of the aperture. 

16. The autostereoscopic imaging apparatus of claim 1, 
wherein said optical element is a first optical element 
defining a first aperture and said operator is a first 
operator, said first optical element being located behind 
said lens, said apparatus further including: 

a second optical element defining a second aperture, 
said second optical element located in front of and adjacent 
said lens; and 

a second operator coupled to move said second optical 
element, such as to produce scanning motion of the second 
aperture relating to the optical axis of said lens. 

17. The autostereoscopic imaging apparatus of claim 1, 
wherein said optical element includes: 
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a first opaque sheet having a first through-slit 
elongated in a first direction, and 

a second opaque sheet having a second through-slit 
elongated in a second direction generally orthogonal to the 
first direction, said first and second sheets positioned in 
parallel juxtaposed relation, such that an intersection of 
the first and second slits defines the optical element 
aperture, and said operator includes: 

a first actuator coupled to reciprocate said first sheet 
in the second direction, and 

a second actuator coupled to reciprocate said second 
sheet in the first direction, 

whereby to produce scanning motion of the aperture. 

18. The autostereoscopic imaging apparatus defined in 
claim 17, wherein said operator further includes a controller 
controlling said first and second actuators to adjust at 
least one of relative phase, frequency and stroke of 
reciprocations of said first and second sheets , whereby to 
vary a pattern traced by the parallax scanning motion of the 
aperture . 

19. Autostereoscopic imaging apparatus, comprising, in 
combination: 

an imaging plane; 

a lens having an optical axis, said lens focusing an 
image of a three-dimensional object on said imaging plane; 
an optical element located adjacent said lens; and 
an operator coupled to activate said optical element 
such as to define a lens aperture located in at least two 
disparity positions offset from the optical axis of the lens 
while recordings of the focused object image are taken, 
whereby to provide image recordings on said imaging plane 
having differing parallax views of the object which, when 
successively displayed at a view cycle sequencing rate of 
three to six Hz, produce an autostereoscopic image of said 
object on a conventional, two-dimensional display. 

20. The autostereoscopic imaging apparatus of claim 20, 
wherein said operator activates said optical element such as 
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to move the lens aperture in a parallax scanning motion 
through the disparity positions. 

21. The autostereoscopic imaging apparatus of claim 20, 
which further includes means for adjusting an opening size of 
the lens aperture. 

22. The autostereoscopic imaging apparatus of claim 20, 
which further includes means for varying a pattern traced by 
the parallax scanning motion of the lens aperture. 

23. The autostereoscopic imaging apparatus of claim 20, 
wherein said operator is conditioned to concurrently define 
plural lens apertures. 

24. The autostereoscopic imaging apparatus of claim 20, 
wherein said optical element comprises a planar array of 
cells, and said operator electrically activates said optical 
element to selectively switch said cells between transparent 
and opaque states, said cells in the transparent state 
defining the lens aperture. 

25 . The autostereoscopic imaging apparatus of claim 25 , 
which further includes means for controlling said operator 
such as to adjust a number of said cells activated to the 
transparent state, whereby to vary an opening size of the 
lens aperture . 

26. The autostereoscopic imaging apparatus of claim 25, 
which further includes means for controlling said operator to 
continuously activate said cells between the transparent and 
opaque states in a manner to produce parallax scanning motion 
of the lens aperture through the disparity positions. 

27. A method of autostereoscopic imaging, comprising 
the steps of: 

providing an imaging lens having an optical axis 
directed toward a scene to be imaged; 
defining a lens aperture; 

moving the lens aperture relative to the lens in a 
parallax scanning motion through diverse disparity positions 
offset from the optical axis of the lens; and 
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generating a succession of time-spaced images of the 
scene as viewed through the lens aperture from a plurality of 
the disparity positions; and 

recording the time-spaced images which , when 
successively displayed at a view cycle sequencing rate of 
three to six Hz, produce a autostereoscopic image of said 
scene on a conventional, two-dimensional display. 

28. The method of claim 28, further including the step 
of adjusting an opening size of the aperture. 

29. The method of claim 28, wherein the moving step 
produces an adjustable parallax scanning motion of the lens 
aperture. 

30. The method of claim 28, further including the steps 

of: 

providing a camera incorporating the lens means and the 
aperture; 

pointing the camera at a scene including a reference 
object positioned a known distance from the camera and a 
target object; 

focusing the lens means to the reference object; and 
quantifying the motion of the recorded target object 
images relative to the recorded reference object images to 
determine the distance between the reference and target 
objects. 

31. The method of claim 40, further including the steps 

of: 

mounting the camera on a piece of robotic equipment; and 
controlling the motion of the robotic equipment piece 
into an operative position relative to the target object 
based on the determined distance between the reference and 
target objects. 

32. The method defined in claim 28, further including 
the steps of: 

providing a camera incorporating the lens means and the 
lens aperture; 

pointing the camera at a scene including a plurality 
objects; 
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detecting, from the recordings of the time-spaced images 
of the scene, relative motions of the images of the objects; 
and 

controlling the moving step to adjust the optical axis 
offset of the disparity positions through which the lens 
aperture is moved in accordance with the detected relative 
motions of the object images. 

33. A method of autostereoscopic imaging comprising the 
steps of : 

providing an imaging plane; 

providing a lens having an optical axis; 

directing the optical axis toward an object; 

creating a lens aperture at a succession of disparity 
positions offset from the optical axis; 

observing an image of the object appearing on the 
imaging plane; and 

adjusting the lens to a focus setting that eliminates 
motion of the object image appearing on the imaging plane. 

34. The method of claim 34, further including the step 
of determining object range from the focus setting. 

35. A camera for recording video images of a scene, 
said apparatus including, in combination: 

an imaging plane; 

a lens for focusing images of the scene on the imaging 
plane, said lens having an optical axis; 

an optical element defining a lens aperture, said 
optical element positioned adjacent said lens such that the 
scene images recorded on said imaging plane are created by 
light passing through the aperture; and 

an actuator coupled to said optical element such as to 
produce parallax scanning movement of the lens aperture in 
directions transverse to the optical axis such that, when 
said images recorded on said imaging plane are successively 
displayed at a view cycle sequencing rate of three to six Hz , 
they produce an autostereoscopic image of said scene on a 
conventional two-dimensional display. 
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36. The camera of claim 36, further including means 
connected to selectively activate said actuator to produce 
controlled movement of the aperture. 

37. The camera of claim 37, wherein said means 
selective activates said actuator to produce parallax 
scanning motion of the aperture. 

38. The camera of claim 37, wherein said means is a 
motion sensor mounted on the camera, said motion sensor 
activating said actuator to produce aperture movement in a 
direction opposite to a direction of spurious camera motion, 
whereby to stabilize the scene images appearing on the 
imaging plane. 

39. A method of autostereoscopic imaging using computer 
simulation, the method comprising the steps of: 

defining an object to be imaged; 
defining a scene to include the object; 

simulating a camera by defining parameters of an imaging 
plane, a lens and a lens aperture; 

rendering images of the object by simulating a desired 
parallax scanning pattern motion of the lens aperture using a 
ray tracing algorithm, said images, when successively 
displayed at a view cycle sequencing rate of three to six Hz, 
producing an autostereoscopic image of said object on a 
conventional, two-dimensional display; and 

storing the rendered images. 
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